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P502838US 

Arbiter for a Queue Management System 

This invention relates to an arbiter for a system containing multiple bus masters, and in 
particular to a bus arbiter in a queue management system (QMS) block in a Bluetooth 
baseband peripheral. The invention also relates to a QMS including such an arbiter. 

A bus arbiter for a QMS is used to decide bus mastership in a system having multiple 
masters each having real time requirements. A master with real time requirements is 
not likely to need to access the bus all the time, but it does need to be sure it can make a 
predetermined number of bus accesses within a given period. Known arbiter blocks 
have a fixed set of priority levels so that, if a high priority block requests mastership, it 
prevents bus access to all lower priority blocks. In some known systems, all the 
prioritisation levels are required to be shuffled, but this rarely leads to a situation that 
can guarantee bandwidth to multiple arbiter blocks. 

The present invention provides an arbiter for a system having multiple bus masters each 
having real time requirements for mastership of a bus, wherein the arbiter is arranged so 
that the amoimt of time that each bus master can gain bus access is a percentage of the 
total bus time. 

This ensures worse case conditions for bus access can be clearly defined, and will not 
be affected by adding or changing the functions of other bus masters. Consequently, 
bus access is evenly distributed, rather than occurring in bursts. 

Preferably, the arbiter further comprises means for allocating priority levels for bus 
mastership when a given bus master does not request bus mastership during its 
allocated percentage of the total bus time. 

The invention also provides a bus master each having real time requirements for 
mastership of the bus, and an arbiter for allocating bus mastership to the bus masters, 
wherein the arbiter is as defined above. 



In a preferred embodiment, the system comprises a QMS, and each bus master is a 
queue user. In this case, the QMS may include a queue portal for each of the queue 
users, a respective queue user interface being positioned between each queue user and 
its portal. 

Preferably, the QMS system further comprises a memory for holding data as it passes 
through the queues, and wherein one of the queue users is constituted by a processor. 

Advantageously, the arbiter includes a state machine for allocating each bus master its 
predetermined percentage of bus time. Preferably, the state machine determines the 
active queue portal arbitration by cycling through a predetermined number of states, in 
a fixed order, or every clock cycle, each of the states being associated with a respective 
queue portal. Conveniently, the percentage of total bus time allocated to a given queue 
portal is determined by the number of states associated with that queue portal. 

In a preferred embodiment, the means for allocating priority levels for bus mastership is 
activated when the queue portal currently selected does not request bus mastership. 
Advantageously, the arbiter is such that the highest of said priority levels is allocated to 
non-interruptible memory sequences triggered by the processor, such that the next 
highest priority level is allocated to accesses to the bus by the processor, and such that 
the next highest priority level is allocated to accesses to the bus by the QMS. 

The invention further provides a Bluetooth baseband peripheral comprising a QMS 
system, link control hardware for communication with Bluetooth devices via a radio IC 
and the QMS system, and a re-usable microprocessor block, wherein the QMS system 
is as defined above. 

Advantageously, the peripheral further comprises an interface block between the bus 
and the re-usable microprocessor block. 



Preferably, the queue users are a communication control block, a host queue user, a 
voice encoder and decoder, and a processor forming part of the re-usable 
microprocessor block. Conveniently, each of the queue users is connected to the bus 
via its queue user interface and a respective bus master and bus tri-state driver. 

The invention will now be described in greater detail, by way of example, with 
reference to the drawings in which: - 

Figure 1 shows the system architecture for a QMS; 

Figure 2 shows the system architecture for a QMS which is used for a Bluetooth 
baseband peripheral; and 

Figure 3 is a flow diagram illustrating the decision processes of a state machine 
forming part of the architecture of Figure 2. 

Referring to the drawings, Figure 1 shows a system architecture which includes a QMS, 
indicated by the dotted-line block 1, a queue manager software interface 2, a core 
(queue manager hardware) 3, and four identical queue portals 4A, 4B, 4C and 4D. The 
portals 4A to 4D are associated with respective queue users 5A to 5D by means of 
queue interfaces 6A to 6D. The queue users 5A to 5D are external entities that accesses 
data stored in a queue. The core 3 includes an arbiter 7, a "memory operation" block 8, 
and a re-allocation block 9. The block 9 includes a block release table 9a and a 
removed blocks FIFO 9b, and communicates with a single port RAM 10. The arbiter 7 
controls access to a bus 1 1 in a manner described below. 

The QMS 1 uses the RAM 10 to hold data as it passes through the queues. The QMS 1 
can support two types of queues, namely asynchronous queues (which are intended to 
hold 'good' data which can be held for an indeterminate amount of time), and 
isochronous queues (which are intended to hold a small amount of time-critical data). 
The mean data rates of the generator and consumer of data in an isochronous queue 
should be approximately the same. The data may be read/written in bursts, which is 
typically why the queue system is required. For isochronous queues, the QMS 1 splits 
the RAM 10 into memory blocks, which are linked together to form variable length 
FIFO queues. The QMS 1 can resize a queue (by adjusting the rules for adding memory 



blocks) as the storage requirement changes. For isochronous queues, a smaller area of 
contiguous memory is used. 

As mentioned above, for each queue user 5A to 5D there is a dedicated generic queue 
portal 4A to 4D. A queue portal 4A to 4D can be used to access a number of queues, 
although it can only read/write to one queue at a time. A queue user 5A to 5D will 
indicate which queues it wants to access, and will then do a series of reads (or writes). 
The queue portal 4A to 4D will map the reads (or writes) into RAM accesses. Within a 
memory block, the data will be stored at sequential locations. At the end of a memory 
block, the relevant queue portal 4A to 4D will follow a link to the next memory block 
in a chain, and start accessing the new memory block. The queue user 5A to 5D will 
not be aware of the linking process (although it will introduce delays to some accesses). 

The read (or write) operations automatically update memory pointers provided in the 
queue portals 4A to 4D. However, for asynchronous queues in which data is expected 
to be good, there may be a requirement to repeat a series of reads/writes (e.g. due to a 
requirement to re-transmit a packet, or due to an error in a received packet). Therefore, 
the queue portals 4A to 4D each has a commit/discard mechanism. As well as the 
current read/write pointer (which is updated every read/write), there is a second pointer 
which can identify the start of a data block. A "data block" is not the same thing as a 
memory block, being a series of consecutive reads/writes, which may be stored within a 
memory block, or in a number of memory blocks. If a queue user 5A to 5D decides a 
data block should be re-read/re- written, it can do a 'discard', which loads the last stored 
* start of data block' pointer into the current pointer. If the queue user 5 A to 5D decides 
a data block is good, it can do a 'commit' which loads the current pointer into the 'start 
of data block' pointer. When a queue user 5 A to 5D is writing to a queue, it will always 
decide to commit/discard before unloading the queue. 

The QMS 1 also includes four flag bits that can indicate boundaries in the data flow. 
The flags are stored at the start of a memory block (they cannot identify a location 
within the block). If the most-significant bit (MSB) of the flags is set, the queue portal 
4A to 4D will advance the current pointer to the start of the next memory block. New 



data will be stored in the new memory block, rather than filling the previous block first. 
The other flags will be used to identify boundaries over multiple MSB boundaries. The 
flags are not necessarily used at the same time as the commit/discard mechanism. The 
queue user 5A to 5D could decide to write several packets before 'committing' to them, 
or it could 'commit' to a fragment of a packet. The flags can be used to help with 
fragmentation and re-assembly of packets, and/or to identify packet headers stored with 
the data. 

For isochronous queues, a simpler mechanism is required. The commit/discard 
mechanism and start of packet indication are not required. The isochronuous queues 
are intended to hold error tolerant, time-critical data (e.g. voice samples). The queue 
uses a simple FIFO approach (with pointers mapped to an area of the single port RAM 
10). If the data generator fills the FIFO, it will advance both the generator and 
consumer pointers, so the oldest data in the FIFO is discarded. If the data consumer 
empties the FIFO, an error will be indicated, and the last data read from the FIFO will 
be repeated. 

Figure 2 shows the system architecture of a Bluetooth baseband peripheral (indicated by 
the dotted line B) which contains the hardware required to implement a Bluetooth 
baseband control. The peripheral is designed to work as a slave peripheral device that 
can interface to a 16-bit processor or a 32-bit processor (the block uses a 16-bit address 
and a 16-bit data bus). The peripheral block includes link control hardware required to 
communicate with other Bluetooth devices via a radio IC and a QMS 21. As with the 
embodiment of Figure 1, the QMS 21 is controlled via a queue manager software 
interface (not shown). The QMS 21 is identical to the QMS 1 of Figure 1, and so is not 
shown in detail in Figure 2. Thus, the QMS 21 conmiunicates vnth a single port RAM 
30, and controls access to a bus 3 1 . The bus 3 1 is associated with a "Firefly" block 32, 
which is a re-usable microprocessor block which consists of an ARM7TDMI processor 
and ancillary blocks including a memory/peripheral controller, and an interrupt 
controller and a UART. 



The QMS 21 decides bus mastership for queue users 25 A to 25D (only 25 A to 25C of 
which are shown - the queue user 25D being constituted by the ARM7TDMI processor 
in the Firefly block 32), each of which has an associated user interface 26A to 26D. 
The queue user 25A is a communication control block (CCB), the queue user 25B is a 
host queue user (HOSTIF), the queue user 25C is a voice encoder and decoder 
(CODEC), and the queue user 25D is a processor. The queue portals associated with 
the interfaces 26A to 26D are not shown in Figure 2, being part of the QMS 21. 

The QMS 21 communicates with the bus 31 via a bus master 33 A and a bus tri-state 
driver 33B. Similarly, the user interfaces 26A to 26D are connected to the bus 31 via 
respective bus masters 34A, 35A, 36A and 37A and respective bus tri-state drivers 34B, 
35B, 36B and 37B. The queue user 25A is connected to the bus 31 by a bus slave 38, 
the queue user 25B is connected to the bus 31 by a bus slave 39, and the CODEC 25C 
is connected to the bus 3 1 by a bus slave 40. The bus 3 1 is connected to the Firefly 
block 32 via up-integration module (UIM) to a bus interface (UBI) block 41 by a UIM 
bus 42. The processor user interface 26D is connected to the block 41 by a direct 
memory access (DMA) upload/download connection 43 The block 41 isolates the UIM 
bus 42 from the bus 31. The block 41 is connected to the bus 31 by a bus master 41 A 
and a bus tri-state driver 41 B. The processor 25D accesses the peripheral block B by 
getting the UBI block 41 to request bus mastership. 

The peripheral block B thus has three main parts, namely 

1 . A link controller that interfaces to a radio, the link controller comprising the CCB 
25A, the CCB queue user interface 26A, a CCB radio interface (CRI) 25R and a 
voile encoding translator (VET) 26T. 

2. A buffer manager that stores data packets and allows processor interaction, the 
buffer manager comprising the UBI 41, the processor interface 26D, the QMS 21, 
and a block of the single port RAM 30. 

3. A host interface that interfaces to an external host device (not shown), the host 
interface comprising the host queue user interface 26B, the host interface 25B 
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(which may be a UART), the voice queue user interface 26C and the CODEC 
25C. 

The arbiter 7 of the QMS 21 is responsible for determining which queue user 25 A to 
25D can access the bus 31, which in turn effects which user can access the RAM 32. 
5 An extemal 'arbit_en' input signal (see Figure 1) acts as an enable to the arbiter 7. 
When enabled, the arbiter 7 includes the following priority levels. 



Priority 


Function 


Highest 


Continuation of un-interruptible operation 




Active queue portal (round robin approach 
to provide guar2inteed bandwidth) 




Processor initiated start of un-interruptible 
operation 




Processor access to Bluetooth block 


Lowest 


Re-allocation function 



m 

p 10 A state machine constituted by the arbiter 7 determines the 'active queue portal' 
^ arbitration. Every clock cycle, the state machine 7 cycles through the states, in a fixed 

order. The only exception is non-intermptible sequences which make the state machine 

wait in its current state. This sequence is:- 



State 


Priority Queue Portal 


0 


The queue portal for the user 25D 


1 


The queue portal for the user 25B 


2 


The queue portal for the user 25D 


3 


The queue portal for the user 25B 


4 


The queue portal for the user 25D 


5 


The queue portal for the user 25B 


6 


The queue portal for the user 25A 


7 


The queue portal for the user 25B 


8 


The queue portal for the user 25D 


9 


The queue portal for the user 25B 


10 


The queue portal for the user 25C 


11 


The queue portal for the user 25B 


12 


The queue portal for the user 25D 


13 


The queue portal for the user 25B 


14 


The queue portal for the user 25 A 


15 


The queue portal for the user 25B 
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This system ensures a certain percentage of the bus bandwidth is available for each 
queue portal. The percentage of bus bandwidth allocated should be sufficient to meet 
the burst requirements of the queue portals, the HOSTIF 25B being allocated 50%, the 
processor 25D being allocated 31.25%, the CCB 25A being allocated 12.5%, and the 
CODEC 25C being allocated 6.25%. The queue portals should work with less than the 
allocated bandwidth, due to non-interruptible sequences that can temporarily increase 
the bandwidth used by other portals. (The implementation should allow these 
allocations to be changed easily.) 

The arbiter 7 also includes an enable bit for each queue portal. The enable bit can be 
used to block requests for mastership (although this will not effect the sequence of the 
state machine). 

If the queue portal currently selected by the state machine (arbiter) 7 does not request 
bus mastership, either because it has no data to transfer or it has been disabled, then one 
of the lower priority functions can become bus master. The next level of priority is 
used for "non-interruptible memory sequences", which are triggered by the processor 
25D, These operations involve reading from memory, and then modifying the contents 
of the memory based on what was read. Starting these operations is considered lower 
priority than queue portal operations (once started, they complete as non-interruptible 
operations which have the highest priority in the arbiter 7). However, the processor 
25D assumes that, once it triggers a non-interruptible memory sequence, by the next 
time the processor accesses the memory, the non-interruptible memory sequence will be 
complete. Therefore, non-interruptible memory sequences have to be higher priority 
than the processor 25D. The next level of priority is the processor 25D accesses to the 
UBI block 41. The processor 25D is treated as being lower priority than the queue 
portals so that the bandwidth available to the queue portals can be guaranteed. If the 
processor 25D attempts to become bus master while a higher priority function is using 
the bus 31, the processor is held in a wait state. This adds some uncertainty to the 
speed at which software remaining on the processor 25D will operate, but this is taken 
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into account when writing the software. The processor 25D should not be held up by 
low priority functions, and so needs to have a higher priority than these other 
non-time-critical functions. (In addition, the processor 25D can modify a control bit in 
the UBI block 41 which disables the normal arbiter 7, and makes the UBI block the bus 
5 master, thereby making the processor the highest priority bus master. However, this bit 
is not used in normal operation.) If no other function is requesting to be bus master, the 
QMS 21 becomes bus master, and can use the 'spare' bus cycles to do low priority 
accesses, such as block re-allocation. 

p 10 Figure 3 is a flow chart illustrating the decision processes of the arbiter 7. The 
n. processes start at step 100, and, in step 101 the arbiter 7 checks to see if it is enabled. 

Ifl If not, the block 40 has bus mastership (step 102), and the arbiter proceeds to step 103 

y to wait for the next clock cycle, at which stage step 1 01 is repeated. 

Q 

^ 15 If the arbiter 7 is enabled, step 104 queries whether the current bus master requests 

ry retention of mastership. If so, that bus master is granted retention of bus mastership (in 

01 

p step 105), and the arbiter 7 then returns to step 103 to wait for the next clock cycle. If 

the current bus master did not request retention of mastership, the arbiter 7 proceeds to 
step 106, where the queue portal is advanced in round robin fashion. If the queue portal 
20 selected in this manner requests bus mastership step (107), the selected queue portal is 
granted bus mastership (or passes mastership to the associated queue user) - in step 108. 
The programme then returns to step 103 to wait for the next clock cycle. 

If the queue portal selected does not request bus mastership, the QMS core is asked 
25 whether a processor initiated memory operation has requested bus mastership (step 
109). If the answer to this question is yes, a memory operation block in the QMS core 
is granted bus mastership (step 110), and the arbiter 7 then returns to step 103 to wait 
for the next clock cycle. If a processor initiated memory operation has not requested 
bus mastership, a check is made (step 111) to see whether the processor 25D has 
30 requested a bus mastership via the block 41 . If such a request has been made, the block 
41 is granted bus mastership (step 1 12) and the arbiter 7 returns to step 103 to wait for 
the next clock cycle. 
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If the processor 25D did not request bus mastership via the block 41, a check is then 
made (step 1 13) to see whether the re-allocation block 9 has requested bus mastership. 
If it has, a check is made to see whether there has been a block release table operation 
(step 1 14). If a block release table operation is required, this is carried out in step 115; 
and, if not, the blocks are removed from the FIFO 9b (step 116). In either case, the 
arbiter 7 then retums to step 103 to wait for the next clock cycle. If the re-allocation 
block 9 has not requested bus mastership the QMS 21 is given bus mastership (step 
1 17), after which the arbiter 7 retums to step 103 to wait for the next clock cycle. In 
step 117, at all times there must be one (and only one) bus master. Hence, if no other 
block wants to be bus master, the QMS block 21 must be the bus master. However, the 
QMS 21 doesn't want to have anything to do with the bus 31, so it drives the address 
and control signals of the bus into a state where it is not actively reading/writing to any 
blocks. 

It will be apparent that modifications would be made to the arbiter described above. 
Thus, the version of the arbiter described above includes a 'hold' signal to allow a 
block to do an un-interruptible read-modify-write cycle. Unfortunately, this 
re-introduces some uncertainty into the number of bus cycles allocated (because the 
'hold' cycles are not counted). If this becomes a problem, the arbiter could take 
account of 'hold' cycles when allocating future bus access (e.g. if a block introduces a 
hold cycle, the next time the arbiter is going to allocate bus mastership to the block, it 
could skip it). 

The arbiter described above uses a state machine with sixteen states. If a finer solution 
in the allocation of bus mastership is required, either more states could be introduced, 
or a numerical algorithm could be used. 

The arbiter described above could be used with any system that needs to control access 
to a resource (usually a bus). Its greatest strength is defining the percentage of time that 
a unit can access a resource. This gives much more certainty to defining the design 
requirements of a block accessing the resource, and any given block doesn't have to 
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worry about that other blocks accessing the resource do. This is to be contrasted with 
known systems with a prioritised access, where changes to a high priority block could 
affect the behaviour of a lower priority block). 



